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Abstract. In this paper we study various approaches for expfoiting symmetries in poly- 
nomial optimization problems within the framework of semidefinite programming relax- 
ations. Our special focus is on constrained problems especially when the symmetric group 
is acting on the variables. In particular, we investigate the concept of block decomposi- 
tion within the framework of constrained polynomial optimization problems, show how 
the degree principle for the symmetric group can be computationally exploited and also 
propose some methods to efficiently compute in the geometric quotient. 



Solving or even computing lower bounds in constrained polynomial optimization is a 
difficult problem with important practical applications. In recent years, results of real 
algebraic geometry on the representation of positive polynomials have permitted to define 
a hierarchy of semidefinite relaxations (SDP-relaxations) of these problems, which provide 
a monotonically nondecreasing sequence of lower bounds converging to the global mini- 
mum. See e.g. Lasserre [21], Parrilo [SU] or the survey [21] and many references therein. 
However, the size of the resulting SDPs grows fast with the problem size; typically, for 
an optimization problem in n variables the SDP-relaxation of order k in the hierarchy 
involves 0{n'^^) variables and linear matrix inequalities (LMIs) of size 0{n^). Therefore, 
and in view of the present status of SDP solvers, the applicability of the basic method- 
ology is limited to small or medium size problems unless some specific characteristics are 
taken into account. 

One way to reduce this size limitation is to exploit symmetries when present in the 
problem definition. In the present paper, which has a foundational character, we consider 
the polynomial optimization problem 



where f,gi,---,gm ^ ■ ■ ■ , ^n]- We assume that the polynomials are invariant by the 

action of a finite subgroup G of the group GL„(M), i.e., f{a~^{x)) = f{x) and gj{a~^{x)) = 
gj{x) for all cr G G, and all j = 1, . . . , m. 



An earlier preprint version of this paper already received attention and is referenced e.g. in the surveys 
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1. Introduction 




inf /(x) 

s.t. gi{x) > 0, . . .,gm{x) > , 
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A major theoretical contribution to a systematic study of symmetries in real algebraic 
geometry was provided by Procesi and Scliwarz [31] who gave a semi-algebraic description 
of the geometric quotient of a semi-algebraic set invariant under a group G [6]. For the 
special case of the symmetric group, Timofte [H] provided a very useful criterion for the 
non-negativity of a polynomial. Cimpric, Kuhlmann, and Scheiderer studied foundational 
aspects of the dual problem of moments [7]. 

The systematic study of block diagonalizations of SDPs was initiated by Gatermann 
and Parrilo [TB] (in the context of symmetries) and by Schrijver [3^ [37] (in the general 
framework of matrix *-algebras). Building on this, de Klerk, Pasechnik, and Schrijver 
[13] have provided a general method (the ^-representation) to handle symmetries of any 
semidefinite program (see also [T7 ] [23 ] |27] ) . Excellent reviews of the above are the surveys 

[21 ig. 

* Contribution: In the present paper, we advance these lines of research in several 
ways: 

1. We provide a systematic treatment of the block diagonalization in the setting of 
Lasserre's relaxation which is concerned with constrained optimization. Instead of con- 
sidering a general SDP framework, we rather focus attention on the specific SDPs coming 
from the relaxation scheme defined in [2l]. Indeed, the symmetries on the original vari- 
ables of the optimization problem induce specific additional symmetry structure on the 
moment and localizing matrices of the SDP-relaxation. To this end we suggest that a 
symmetry-adapted version of the relaxation scheme can be defined directly using an ap- 
propriate basis for the moments and derive symmetric versions of Putinar's Theorems 
(see Theorems 13.21 and 13. 5p . We study a possible basis (generalized Specht polynomials as 
defined in Section UT]) in detail for the case of the symmetric group Sn- In this situation 
we show that for k fixed, the number and sizes of the LMIs in the SDP-relaxation of 
order k are bounded by a constant that does not depend on the number n of variables 
(Theorem 14. 7p . As a direct consequence, we can state some symmetric versions of rep- 
resentation theorems for sums of squares, in particular for the "Hilbert cases" (Theorem 
14.101 and corollaries). 

2. We show how the so-called degree principle ([331 Ej) can be used to transform an 
(S„-invariant optimization problem into a set of lower dimensional problems and that in 
some cases the resulting relaxation scheme converges finitely (Theorem 15. 4p . This gives 
a sum of squares based criterion to certify non-negativity of an iS„-symmetric polynomial 
of degree 4 (Theorem 15. 5p . 

3. We show how the geometric quotient viewpoint naturally leads to a Polynomial Ma- 
trix Inequality (PMI) problem. For certain power sum problems (generalizing a situation 
studied by Brandenberg and Theobald [5]), we discuss how this leads to lower and upper 
bounds which can be computed quite simply (Theorems 16.61 and 16. 7p . 

Our techniques enlarge the techniques for handling constrained optimization problems 
with symmetries. We feel that it is worth to present them in a common context. We 
focus to a large extent on the case of the group Sn- This has several reasons. Firstly 
the problems that motivated the research leading to this paper came from this setting. 
Secondly it turns out that in the situation of symmetric polynomials the complexity of 
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the optimization problem as a function of the number of variables can be dramatically 
reduced with all the techniques we provide. Moreover, the symmetric group serves as a 
rich example to demonstrate general principles, and we remark that many combinatorial 
optimization problems can be put into the form of maximizing a given linear form on the 
orbit of a vector in a representation of the symmetric group (see [31 H]). Whereas (on the 
SDP level) the general framework of block diagonalization is already well understood the 
degree principle still awaits its generalization for other groups. 

The authors are aware that certain algebraic techniques used in this paper might not be 
very familiar to optimizers in general, which may induce doubts about any real systematic 
implementation in some fully automized software, at least in some near future. However, 
there are also reasons to be more optimistic in view of the growing interest in semidefi- 
nite relaxations for polynomial optimization, and their current limitation to problems of 
modest size only, if no sparsity or symmetry is not taken into account. 

The paper is structured as follows. In Section [2], we give a short introduction to the 
SDP relaxation scheme and to PMIs. Furthermore we introduce some representation the- 
oretical notions, with special focus on the symmetric group iS„. In Section E] we give a 
systematic treatment of how invariance by a finite group can be exploited in the relaxation 
scheme introduced in [2l]. Section HJis devoted to a study of optimization with symmetric 
polynomials. We give a detailed construction of the related moment matrices. From the 
constructions we then deduce representation statements for symmetric positive polynomi- 
als. In Section [5] we show how it is possible to use the degree principle to break some of 
the symmetry and construct thereby a family of lower dimensional problems, which can 
be used to solve the original optimization problem. 

Finally, in Section |H] we show how optimization problems described by invariant poly- 
nomials can be treated in the orbit space. As a direct application of this procedure we 
can show how to calculate bounds for a specific class of problems. 

2. Preliminaries 

Let M.[X] be the ring of polynomials in the variables X = (Xi, . . . and M[X]<fc 
be the subset of polynomials of degree at most k. In the following subsections, we recall 
Lasserre's relaxation scheme for polynomial optimization, polynomial matrix inequalities 
(PMIs) and some basic concepts of representation theory. 

2.1. Lasserre's method. Given polynomials f,gi,...,gm G consider the general 

optimization problem of the form 

/* = inf f{x) subject to gi{x) >0,..., g.m{x) > . 

Its feasible set C M"- is the basic closed semi algebraic set 

(2.1) K := {xeR^ : g,{x) > 0, j = 1, . . . ,m}. 

In [21] Lasserre has introduced the following hierarchy of semidefinite relaxations (see 
also [251122]). For reasons described below we will need the following technical assumption: 
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Assumption 2.1. The feasible set K defined in (12. ip is compact and there exists a 
polynomial u G W\X] such that the level set {x G : u{x) > 0} is compact and u has 
the representation 

m 

(2.2) U = Up + Uj Qj 

i=i 

for some sums of squares polynomials Mq, Mi, . . . , Mm ^ 

Assumption 12. II holds if e.g. for some j G {1, . . . , m} the level set {x G M" : gj{x) > 0} 
is compact, or if K is compact and all the gj^s are affine (in which case is a poly- 
tope). In particular, Assumption 12.11 holds if and only if for some A G N, the polynomial 
A — Yyi=i-^i can be written in the form (12. 2p : equivalently, this polynomial belongs to 
the quadratic module generated by the g/s. For a comprehensive discussion of the last 
condition see [35l Theorem 1]. Notice that under Assumption 12. ![ K is compact and thus 
the infimum /* is attained on K. 

The idea is to convexify the problem by considering the equivalent formulation 

(2.3) f* = min f (x) = min / f da , 

where 'P{K) denotes the set of all probability measures /i supported on the set K. These 
measures are characterized by the following statement due to Putinar. 

Theorem 2.2 (Putinar [32])- Suppose Assumption \2.1\ holds for the set K. A linear map 
L : M[A] — M zs the integration with respect to a probability measure fi on K, i.e., 



3fiEV{K) \/peR[X] L{p) = J 



pdfi , 



if and only if L{1) = 1 and L{so + Yl^Li ^j9j) ^ /o?" (^ny sum of squares polynomials 
So,...,Sm G R[X]. 

Setting go := 1, the condition in Putinar's result is satisfied if and only if the bilinear 
forms , • • • , defined by 

Cg^ : R[X] X R[X] M, 

(p,g) ^ L{p-q-gj) 

are positive semidefinite (psd). With this characterization we can restate (12.31) as 

(2.4) /* = min {L(/) : L : R[X] R linear, L(l) = 1 and each Cg^ is psd} . 

Now fix any basis B of the vector space R[X] with 1 G i3 (for example the monomial 
basis A""). For any linear map L : R[X] R with L{1) = 1, setting = L{h) for 6 G i3 
identifies L with an infinite series y = {yb)beB of real numbers indexed by the elements 
of B. The infinite-dimensional moment matrix M associated to y is indexed by B and 
given by 

M{y)u,v ■= L{u-v), u,veB. 
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Furthermore for each Qj define in an analogous manner the localizing matrix M{gj y) by 

M{gjy)u,v ■= L{u-v-gj), u,veB. 

Under Assumption 12.11 a given sequence y comes from some measure fi supported on 
K if and only if the moment matrix as well as the localizing matrices are psd. For 
practical applications of this approach, truncated versions of fl2.4p have to be considered: 
Let k > kf) := max{[deg//2], \deggi/2'], . . . , \deg gm/2]}. Define the finite-dimensional 
matrix Mk by considering only rows and columns indexed by elements in B of degree at 
most k, and consider the hierarchy of semidefinite relaxations 

inf,L(/) 

^ ' Mfc_rdeg3,/2i(^7,Z/) ^0, l<j<m, 

yi = 1 , 

with optimal value denoted by inf Qk (and minQfc if the infimum is attained). 

Although each of the relaxation values might not be optimal for the original problem, 
one has the following convergence result. 

Proposition 2.3 (Lasserre [21]). Let Assumption \2. 1\ hold and consider the hierarchy of 
SDP-relaxations {Qk)k>ko defined in Ii2.5\) . Then the sequence {ini Qk)k>ko ^■^ monotoni- 
cally non- decreasing and converges to /*; that is, inf Qfc t /* os — )■ oo. 

Although there are sufficient conditions to decide whether an optimal value has been 
reached after a certain iteration (see for example pU| [25]). in general only in some situa- 
tions finite convergence can be guaranteed: 

Proposition 2.4 (Laurent [2S])- Let f,gi,...,gm G and consider the problem 

(2.6) inf {fix) : g^ix) = ■■■ = g^x) = 0} . 

If the ideal generated by gi, . . . , g^ is zero- dimensional then the Lasserre relaxation scheme 
of (12.61) has finite convergence, i.e., there is an I > /cq such that inf Qi = f* . 

2.2. Polynomial matrix inequalities. An interesting case of a polynomial optimization 
problem which will be relevant for some of our approaches arises when dealing with positive 
semidefiniteness of a matrix whose entries are polynomials. 

Let Sm denote the set of real symmetric m x m-matrices. A polynomial matrix inequality 
(PMI) optimization problem is an optimization problem of the form 

/* = inf^-giRn f{x) 
s.t. G{x) y 

where / G ]R[X] and G{X) is a symmetric m x m-matrix whose entries Gij{X) are 
polynomials in X. 

By considering the psd condition on G{x) as polynomial constraints and using the 
approach from Subsection 12.11 one would have to deal with polynomials of large degree. 
Even if all Gij{X) are linear for example the polynomial inequalities one needs to consider 
are of degree m. This high degree could make it even hard to explicitly calculate the first 
possible relaxation. 
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To overcome this problem, SDP hierarchies were proposed in [191 Ej that take into 
account the semidefiniteness of a polynomial matrix. The basic idea is to generalize the 
standard approach in a suitable way by defining a localizing matrix for the matrix G{X). 
This (infinite) matrix consists of blocks which are indexed by the elements of a basis B of 
M[X], the entries of each block are indexed with the entries of G{X), and the entry i,j of 
the block corresponding to u,v E B is 

M{Gy)lf := L{u-vG,j{X)), u,veB, z, j G {1, . . . , m}. 

Setting d := max{ [deg Gij(X)/2] } and k > ko := max{ [deg //2] , c?}, one can define a 
relaxation 

inf,L(/) 

(2.7) Qk-. Mk{y) h 0, 

Mk-d{Gy) h 

with the truncated matrix Mk of M. In order to guarantee the convergence of this 
relaxation one needs to assume the Putinar condition viewed in this setting: 

Assumption 2.5. Suppose that there is m G such that the level set {x G : 

u{x) > 0} is compact and u has the representation 

(2.8) u = + {R{X),G{X)) 

for some sum of squares polynomials uq G M\X] and a symmetric sum of squares matrix 
R{X) G M[X]"^^™. 

Then the following convergence statement holds [19] . 

Proposition 2.6. If G{X) meets the Assumption \2.5\ then the sequence {inf Qk)k>ko is 
monotonically non- decreasing and converges to f*. 

2.3. Linear representation theory. We collect some notions from linear representation 
theory. As standard reference see [38]. For our purposes, we always assume that G is a 
finite group and that K is either the field M of real numbers or the field C of complex 
numbers. 

A representation of G is a finite-dimensional vector space V over K together with a 
group homomorphism p : G ^ GL{V) into the set GL(V) of invertible linear transforma- 
tions of V. If a basis for V is chosen, then the representation can be expressed as a group 
homomorphism into the group GL„(]K), where n := dim^. This is known as a matrix 
representation. The action of G turns V into a G-module, and in fact, the notion of a 
representation of G and the notion of a G-module are equivalent and can be identified. 
Two representations (V, p) and {V, p') of the same group G are equivalent if there is a 
linear isomorphism (p : V ^ V such that p'(a") = p(a') for all a G G. 

Example 2.7. (1) The one-dimensional representation (id, K) (i.e., V = 1K and group 
action a{v) = v for all a G G and f G K) is called the trivial representation. 
(2) Take any set S on which G operates and set V = 0^^^ Ce^ with formal symbols 
Cs {s G S). Then the obvious action of G on defined via a^Cg) = eo-(s) turns 
V into a G-module. In the special case when S = G this is called the regular 
representation. 
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If there is a proper G-submodule W of V (i.e., a G-invariant proper subspace W of 
V) then the representation (p, V) is called reducible. If, however, the only G-invariant 
subspaces are V and {0}, then {p,V) is called irreducible. For a finite group G, any 
representation (V, p) decomposes as a direct sum of irreducible representations, p = 
©iLi iTT-iPi with multiplicities mj. This induces an isotypic decomposition of the G-module 
y as a direct sum V = 0^=^ Vi with isotypic components Vi = Wij, finite index sets 

Ji with I Jj| = rrii, and, for fixed z, pairwise isomorphic, irreducible components Wij (where 
each component Wij is associated with the irreducible representation pi). Whereas the 
decomposition in isotypic components is unique, the decomposition of the Vi is in general 
not unique. 

The following basic but fundamental result of representation theory will be very useful 
(see, e.g., [381 Proposition 4]). 

Lemma 2.8 (Schur's Lemma). Let {pi,V) and {p2,W) be two irreducible representations 
of a group G (over M or C). Then every G-homomorphism V ^ W is either zero or an 
isomorphism. Moreover, if two complex irreducible representations {pi,V) and {p2,W) 
are isomorphic then the vector space of all G-homomorphisms V ^ W has dimension 1. 

When working with real representations a little precaution is necessary and it can be 
useful to pass to the complexification of the real representation. For a real irreducible 
representation {p,V) the following three types are distinguished (see [3H1 Section 13.2]): 
If the complexification is also irreducible (type I) then statements such as the second 

part of Lemma [2.81 directly transfer from V ®'doV. However, it may occur that a real 
irreducible representation (p, V) becomes reducible when passing to the complexification. 
In this case, ® C will decompose into two complex-conjugate irreducible G-submodules 
Vi and V2. Since Vi and V2 are complex conjugates we can "virtually" keep track of this 
decomposition by decomposing ® C as Vi + V2 © \{yi — V2), where i is the imaginary 
unit. This is a real basis of V^, which respects the decomposition oi V ®C Either the 
G-submodules Vi and V2 are non-isomorphic (type II) or they are isomorphic (type III). 

Let y be a real G-module. If the complexification V®G has the isotypic decomposition 
V = Vi © ■ ■ ■ © V2Z © V21+1 © ■ ■ ■ © V/i, where each pair (V2j_i, V2j) is complex conjugate 
(1 < j < /) and V2/+1, . . . ,Vh are real, the decomposition 

(2.9) V = (Vl + V2)©Y(vi-y2)©---©(V^2i-l + V^20©T(V2^-l-V^2/)©V^2i+l©---©^h 

is called a real decomposition. 

2.4. Symmetric group. An important special case is when G is the symmetric group 
Sn on n variables. We collect some well-known facts on the irreducible representations of 
Sn. For a general reference we refer to [M] . 

For n > 1, a partition A of n (written A h n) is a sequence of weakly decreasing positive 
integers A = (Ai, A2, . . . , A;) with X]i=i -^j — For two partitions A, p h n we write A > p 
if Ai + ■ ■ ■ + Aj > pi + ■ ■ ■ + Pi for alH. A Young tableau for A h n consists of / rows, 
with Aj entries in the i-th row. Each entry is an element in {1, . . . , n}, and each of these 
numbers occurs exactly once. A standard Young tableau is a Young tableau in which all 
rows and columns are increasing. 
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Example 2.9. For the partition A = (4, 3, 1, 1, 1) h 10, an example of a Young tableau is 



1 


3 


4 


6 


5 


7 


8 




9 




2 




10 





An element a E Sn acts on a Young tableau by replacing each entry by its image under 
a. Two Young tableaux ti and t2 are called row equivalent if the corresponding rows of 
the two tableaux contain the same numbers. The classes of equivalent Young tableaux 
are called tabloids, and the class of a tableau t is denoted by {t}. Let {t} be a A-tabloid. 
The action of Sn gives rise to an 5„-module: 

Definition 2.10. Suppose A h n. The permutation module corresponding to A is the 
iS„-module defined by = span{{ti}, . . . , {t/}}, where {ti}, . . . , {t/} is a complete list 
of A-tabloids. 

Example 2.11. IfA = (l,l,...,l)l-r2 then is isomorphic to the regular representa- 
tion of Sn from Example 12.71 In case A = (2, 1) a complete list of A-tabloids is given by 
the representatives 



(2.10) m L2J m . 

Let t be a Young tableau for A h n, and let Ci, . . . ,Ci, be the columns of t. The group 
CStabt = X x • • ■ x Sc^ (where is the symmetric group on Ci) is called the 
column stabilizer of t. 

The irreducible representations of the symmetric group Sn are in 1-1-correspondence 
with the partitions of n, and they are given by the Specht modules, as explained in the 
following. 

For A h n, the polytabloid associated with t is defined by 

(2.11) = Yl sgn(a)a{t}, 

o-GCStabt 

where sgn((T) denotes the signum of a. Then for a partition A h n, the Specht module 
is the submodule of the permutation module spanned by the polytabloids {ct : 
t Young tableau for A h n}. The dimension of is given by the number of standard 
Young tableaux for A h n. 

Example 2.12. For > 2, we have the decomposition into irreducible components 
M("-i'i) = © Namely, since the one-dimensional subspace spanned by the 

sum ti + - ■ ■+tn is closed under the action of Sn, we have a copy of the trivial representation 
(which is isomorphic to the Specht module S*^"-*) as irreducible component in M^"'~^'^\ 
Moreover, since the tabloids in f l2.10p are completely determined by the entry in the 
second row, we have identified a copy of the {n — l)-dimensional Specht module S'*-""^'^^ 
in M^"'~^'^\ Indeed, the permutation module M*^"~^'^) decomposes as M*^"~^'^) = S^"^^ © 
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The decomposition of the module M for a general partition A h n will be of special 
interest for us. It can be described in a rather combinatorial way as follows: 

Definition 2.13. (1) A generalized Young tableau of shape A is a Young tableau T 
for A such that the entries are replaced by any n-tuple of natural numbers. The 
content of T is the sequence /i such that /ij is equal to the number of i's in T. 

(2) A generalized Young tableau is called semi standard, if its rows weakly increase 
and its columns strictly increase. 

(3) For A, yU h n the Kostka number Kx^ is defined as the number of semi standard 
Young tableaux of shape A and content /i. 

The significance of these definitions lies in the following statement which originates 
from Young's work: 

Proposition 2.14. For a partition n, the permutation module can be decomposed 
as 

3. Symmetry- ADAPTED relaxation 

As a first possibility to exploit symmetries in the framework of polynomial optimization, 
we consider the relaxation scheme introduced in Section 12. 1[ Throughout the section, let 
/,(?!,..., (yfm G M[X] and K be the feasible set (12. ip . 

The relaxation scheme yields a sequence of semidefinite programs. While it is one 
possibility to exploit the symmetries on the level of the SDP, the approach in this paper is 
to approach it on the level on top of this, i.e., on the level of the polynomials. To the best 
of our knowledge, in the framework of the relaxation scheme, no detailed investigation has 
been made on the use of other polynomial bases (different from the standard monomial 
basis). Here, the formulation of the relaxation scheme in the symmetry-adapted basis will 
yield us symmetry-adapted versions of Putinar's Theorems (Theorems 13.21 and 13. 5p and a 
symmetry-adapted relaxation scheme that converges (Theorem 13. 7p . 

In the following assume that G is a finite group, although most of the results could 
be generalized to compact groups. We start by considering linear group actions of G on 
M": For a set 5 C R"" and a e G, let a{S) = {x e R"" : a'^x) e S}. By setting 
p'^{x) := p{a~^{x)) for any polynomial p G R[X] and x G M", G induces a group action 
on M[X]. U p'^ = p for all a E G, then the polynomial p is called G-invariant. 

Following Section [2l we now consider the probability measures V{S) supported on a 
set S. For fi G V{S), a G G and a'^S) C S define fj,'' by /x"(5) = /i((T-i(5)) for 
any Borel set B C S. A measure /x G ^(5") is said to be G-invariant ii n = for 
all 0" G G, and the subset of all G-invariant probability measures on S is denoted by 
V{S)^. For a comprehensive foundational treatment of invariant measures we refer to 
[7]. Here, we mainly need the subsequent simple connection, where for a set S" C M"- we 
define S'^ = Ho-eG '^i^) • A set 5" is called G-invariant if S* = S*^. Note, however that a 
G-invariant feasible set K does not necessarily require that any of its defining polynomials 
Qj is G-invariant. 



lOCORDIAN RIENER, THORSTEN THEOBALD, LINA JANSSON ANDREN, AND JEAN B. LASSERRE 

Lemma 3.1. Let the feasible set K C he G-invariant. If h & is G-invariant 

then 

inf h(x) = inf hdii. 

Proof. We have 

h* := ini h(x) = inf [ hdfx < inf [hdfx, as V(K)^ C V(K) . 



Let [xk] be a minimizing sequence in K such that h{xk) — j- /?-* as — )■ cxd. To each Xk 
we can define a Dirac measure /i^ supported in Xk- Now this gives a converging sequence 
(J h{x)dfik)- The measure /i| := XIo-gg /^fc contained in V{K)'^ for every k. Since is 
G-invariant, J h{x)dfil = h{xk) which in turn imphes / h{x)d^\ h* < inf^g-p(/^)G / fdfi, 
and so h* = inf^gp(^)G / fdfi. □ 



So in order to find the infimum of a G-invariant function / on a G-invariant set K we 
only have to consider the invariant measures supported on K. Hence to make a relaxation 
scheme for this setting similar to the one presented in Section I2.H it suffices to consider 
G-linear maps : R[X] -> M, i.e., linear maps with Lf^[f) = L^^f) for all / G M[X] 
and a & G. In analogy to Putinar's Theorem 12.21 we can also characterize them in terms 
of bilinear forms. 

Theorem 3.2. Let gi,...,gjn G M.[X] be G-invariant, and assume that the feasible set 
K satisfies Assumption \2.1\ Setting g^ := 1, a G-linear map : R[X] W is the 
integration with respect to a G-invariant measure on K if and only if the bilinear forms 

£g : M\X] X M[X] ^ M 



are psd for all < j < m. 



Note that the definition of C^. only uses the values of L'^ on the invariant ring ]R[X]'-^ C 
Indeed, any G-linear map L*^ : ]R[X] — )■ M is already completely determined 
by its values on ]R[X]'-^, since for any p G M.[X] we have L{p) = j^^J^aeG^'^iP'^) ~ 
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Proof. Only if part. Let : W[X] — M be the linear functional associated with a 
G-invariant measure /i, L^{f) := jj^fdfi. Then 

I I J K 



leG- 

> a,s Qj > on K. 
If part. Conversely, let be as in the statement of the theorem. Then for all h G M[X], 



< = ^"(^E(^'r^.)=^'(^E(^^^^^^^ 



9j 

1*^1 aeG 

= -—2_^L^ih'^gj) as L*^ is G-invariant. 

1*^1 aGG 

Since this holds for all h G M[X] and all j = 1, . . . ,m, by Putinar's Theorem is the 
integration with respect to some measure fi on K. In addition, for every h G M[X] and 
every a G G, 

/" /ic//i = L^{h) = L^{h'') = [ h^dfi = I hdfi% 
Jk Jk Jk 

and so as K is compact, fi = fi'^ for all a & G, i.e., /i is G-invariant. □ 

So the G-invariant optimization problem ( II. ip can be rephrased as 
(3.2) 

p* = inf : a G-linear map R[Xf ^ M, = 1 and each £gis psdj . 

The reformulation gives already a first computational advantage compared to the usual 
approach. By the definition of £^ in (13. ip we can phrase the moment matrix in terms 

of variables which are merely indexed by a basis B of the invariant ring M[X]'^. This 
reduction on the number of moment variables is illustrated in the following example. 

Example 3.3. Let G4 denote the cyclic group of order four that operates on by 
cyclically permuting the coordinates. The space of G4-invariant polynomials of degree at 
most 2 is spanned by 60 := 1, h := j{xi + X2 + + x^}, 62 := ^{^1 + xl + xl + xl), 
63 := \ix1X2 + X2X3 + X3X4, + X4X1), 64 := |(xiX3 + X2X4). By identifying yi = L^{hi) with 
moment variables j/o, . . . , j/4, the (truncated) psd condition (13. ip for polynomials of degree 
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at most 2 can be stated as a matrix psd condition in only four variables . . . , 1/4, 



/ 1 


yi 


yi 


yi 


2/1 \ 


yi 


2/2 


2/3 


2/4 


2/3 


yi 


2/3 


2/2 


2/3 


2/4 


yi 


2/4 


2/3 


2/2 


2/3 


Ui 


y-i 


2/4 


2/3 


2/2 / 



In addition to this reduction of the number of variables, the structure of the moment 
matrix approach can be simplified based on representation theory. In order to apply the 
methods from Section [273| observe that for any k > 0, the subset (of of polynomials 

of total degree at most k is finite-dimensional and thus can be viewed as a real G-module. 
As a consequence of this exhaustion process for M[X], there exists a complex decomposition 
of the form 

h h 

(3.3) M[X]®C = = 00iy., 

1=1 i=l j£Ji 

with complex irreducible components Wij, and corresponding real decomposition of the 

form (EH), 

(3.4) 

R[X] = {Vi + 1^2) © t(V^i - 1^2) © ■ ■ ■ © {V21-1 + V21) © ^iV2i-i - V21) © V21+1 ®...®Vh, 

where i is the imaginary unit. Note that the index sets Ji, . . . , Jh may be infinite now. 
The component with respect to the trivial irreducible representation is the invariant ring 
M[X]'^, and the elements of the other isotypic components are called semi-invariants. 

Fix an z G {l,...,h}. Since the Wij are pairwise isomorphic, we can choose G- 
isomorphisms 0* : Wn — )■ Wij, j G Ji. Further we can assume that Wn is generated 
by a basis {s\^^ '■ ^ < u < dimWij} C C[X], such that any s^^ is in the G-orbit of s\i. 
The basis vector transfers to Wij by the G-isomorphism 0* via s* := (f)^j{s\^), and 
thus by this isomorphism 0* the whole basis {s\^ '■ ^ ^ u < dimWn} of Wn transfers to 
a whole basis {sj ,^ : I < u < dim Wij} of Wij. Set 5* = {^.i '■ J ^ Ji}- 

Using the bookkeeping techniques from Section 12.31 (describing the transition from (13. 3p 
to (13. 4p ). the set iS* C C[X] can be transformed into a subset of M[X] by distinguishing 
the types I, II, and III. Therefore without loss of generality we can assume iS* to be real. 

Theorem 3.4. Let gi, . . . , Qm ^ M.[X] be G-invariant, assume that the feasible set K sat- 
isfies Assumption \2.1\ and set qq := 1. A G-linear map : M\X] — M the integration 
with respect to a G-invariant measure ix on K if and only if for all i G {1, . . . , /z} and 
all j G {1, . . . ,m} the bilinear map from (13. ip restricted to iS* (C M[X]) is positive 
semidefinite. 

Proof. By Theorem 13. 2[ L*^ is the integration w.r.t. a measure fi supported on K if and 
only if all the bilinear forms C^. from (13. ip are psd. Clearly, the latter condition implies 
that all the restrictions to the iS* are psd. 
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Conversely, to keep indices simple, fix one of the polynomials go,...,gm and call it 
shortly g. By assumption, the restriction of to any iS* is psd, 1 < i < h. We show 
that this already implies that C'^ is psd. To this end, we first show that for distinct real 
isotypic components Vi and 14 we have L'-^{pi ■ Pk ■ g) = for all pi G V/ and pk G V^. 
Indeed, each pi defines a linear map 

Hence, the application pi H- Xpi gives rise to a G-homomorphism from V/ to the dual space 
(and thus to a G-homomorphism from V/ to V^.) But by Schur's Lemma [2.81 this has 
to be the zero map and thus C^{pi, <?) = for all g G V/,.. 

Consequently it suffices to show that for every i G {l,...,h} the positive semidefi- 
niteness on 5* implies already positive semidefiniteness on Vi. We first assume that Vi 
comes from a complex irreducible representation of type I. Consider a pair Wij,Wik in 
the decomposition f l3.3p . where we allow j = k. Similar to the above reasoning, Schur's 
Lemma can be applied by considering a linear map tpj^k '■ Wij — > Wik defined by its images 
on the basis vectors, 

^jAsiu) ■■= Yl 4,J ■ 4,. , 1 < M < dim Wij . 

V 

Since by Schur's Lemma a G-isomorphism from Wij to Wik is unique up to a scalar 
multiplication we can write this map as a composition ^ = Cjk ■ (pl. o where the 

constant Cjk can be chosen real. This implies 

where 6uv denotes Kronecker's delta function. Since any f E Vi can be written in the form 
/ = J2j ^j,u^],u with aj^u £ the G-invariance of gives 

j u j u u j j 

which is nonnegative since is psd on S\ For the other types (II and III) the result is 
implied in the same way by taking additionally into account the bookkeeping techniques 
explained in Section [273] (see also Example 13.91 below). Therefore the forms £^ are psd 
on M.[X] if and only if the restrictions to each 5* are psd and the statement follows with 
Theorem O □ 

We also record the following symmetric version of Putinar's Positivstellensatz, which 
follows from dualizing Theorem 13. 4[ 

Theorem 3.5. Let f,gi,...,gm G R[X] be G-invariant, and let the feasible set K satisfy 
Assumption \2.1\ If f is strictly positive on K, then f can be written in the form 

h m h 

f = p°(E*+EftE«0 

i=l j=l i=l 

where is a sum of squares of polynomials in S\ l<i<h, l<j<m, and p^{p) = 
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Putting all this together we obtain the following symmetry-adapted relaxation scheme. 
For every /c e N let B2k be a basis of the set M[X]<2fc of G-invariant polynomials of degree 
at most k, with 1 e B2k- Any G-invariant map L*^ : M[X]<2fc ~^ ^ can be identified 
with a finite sequence y = {yb)b£B2k by setting := L'^ih) for h G B2k- With regard to 
the real decomposition of M[X]<fc coming from the truncation of (13 ■4p . construct the sets 
S\ = {s\, $2, . . . ,slj_} C of the basis elements of 5* of degree at most k. Then we define 
the symmetry- adapted moment matrix M^{y) by 

h 

(3.5) M^iy) := 0Mg(y), where M£(|/K^ := £^(4,4) = 

1=1 

The entries of M^{y) are linear combinations of the elements of y and hence indexed by 
elements in B2k- Defining the symmetry- adapted localizing matrices in a similar manner, 
we obtain the symmetry- adapted relaxation for k > k^ := max{ [deg //2] , [deg(7i/2], 
...,[deg 

inf. L<^{f) 
^G. M^{y) h 0, 

^^•^^ Ml^ae,,,mi9,y) ^ 0, l<j<m, 

2/1 = 1, 

with optimal value denoted by inf (and minQ^ if the infimum is attained). 

Remark 3.6. Computational aspects: The symmetry-adapted setting defined above can 
give a significant reduction compared to the original relaxation scheme. Indeed the number 
of variables involved equals the size of B2k- Furthermore the symmetry- adapted moment 
matrix is block diagonal with blocks of sizes rji, . . . ,r]h- 

If the irreducible representations of a given group are known then isotypic decompo- 
sitions and therefore the basis polynomials s*- can be algorithmically computed using 
projections (see, [381 Prop. 8]). 

With regard to determining the irreducible components, there are theoretical methods 
whose computational complexity is bounded by a polynomial in |G| (see [T]). For practical 
purposes, the size |G| of the group might not be the appropriate measure of complexity, 
and indeed, there are practical methods (see [101 [12]) which are implemented in the group- 
theoretic software GAP [TSj . 

Note that all these pre-computations have to be done only once for a specific group and 
relaxation order. 

In this setting. Proposition 12.31 can be reformulated as follows. 

Theorem 3.7. Let f,gi, . . . ,gm M.[X] be G-invariant, let Assumption \2.1\ holds for the 
feasible set K , and let {Q^)k>ko be the hierarchy (13. 6p of symmetry- adapted SDP-relax- 
ations. Then (inf Q^)k>k(, is a monotonically non- decreasing sequence that converges to 
f*. 

Proof. As V{K)^ C V{K) one has inf > inf for all k > k^. In addition, for any 
measure fi on K we let /i* = j^J2aeGf^'^- G-invariant, is also supported 
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on K. This proves that inf Q'^ < f* for all k > ko, and so, inf Qk < inf < /* for all 
k > ko- Combining the latter with Proposition 12.31 yields the desired result. □ 

Remark 3.8. If - more general than the setting considered in this article - not all gj 
are G-invariant but the set K is G-invariant or even if just the set of optimal values is 
invariant, it is still possible to only look at invariant moments. However the above block 
structure will in general only apply for the moment matrix and the localizing matrices for 
the G-invariant polynomials. Note, however, that the variables in the localizing matrices 
still correspond to a basis for the space of G-invariants. 

The general setting presented in this section leads to the question of handling the 
hierarchy of symmetry-adapted bases for the hierarchy of vector spaces of polynomials. 
Before studying in detail the symmetric group in the next section, as a warm up, it is 
worth to revisit Example 13.31 

Example 3.9. We continue Example 13.31 Since the cyclic group G4 is abelian, all the 
irreducible representations are one-dimensional and correspond to the fourth roots of unity. 
Consider the symmetry-adapted relaxation for k = 1. Using the methods from Remark l3.6l 
we find ® C = 0^=^ V/, where V/ = span{^^^-^ w/Xj} and ui, ... ,074 denote the 

fourth roots of unity. Thus, with regard to the symmetry-adapted moment matrix (13. 5p . 
we obtain 5f ~^ = span{^^^-^(a;/ -|- Ui^)Xj} and Sf" = spanji J2^j=ii^i ~ where 
1 < / < 2. With the notation of Example 13.31 the truncated symmetry-adapted moment 
matrix is 

/ 1 2yi \ 

2yi y2 + 2?/3 + 2/4 

7/2-2/4 . 

2/2-2^/3 + 2/4 

\ 2/2 - 2/4 / 

We get 4 diagonal blocks (of which 3 are elementary) and so we end up with a 2 x 2 
semidefiniteness constraint instead of a 5 x 5 one if symmetry is not exploited. 

4. Optimizing with symmetric Polynomials 

In this section, we provide several techniques to exploit symmetries for the symmetric 
group Sn- While the representation theory of the symmetric group is a classical topic (as 
reviewed in Subsection 12. 4p . it yields some interesting (even somewhat surprising) results 
in our setting. 

First, in Section 14.11 we discuss the symmetry- adapted relaxation for the symmetric 
group. By realizing the irreducible components in a suitable basis of polynomials (gen- 
eralized Specht polynomials as defined below), the moment matrix can be characterized 
rather explicitly (Theorem 14. 6p . As corollaries, we derive some concrete representation 
theorems for symmetric polynomials in Section 14.21 
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4.1. Moment matrices for the symmetric group. Recall from the preliminaries that 
the irreducible representations of iS„ are in natural bijection with the partitions of n. In 
order to construct a suitable generalized moment matrix we will need a graded decompo- 
sition of the vector space M[X] into iS„-irreducible components. A classical construction 
of Specht gives a realization of the Specht modules as polynomials (see [39]): 

For A h n let t be a A-tableau. To t we associate the monomial X* := IliLi "^1^*^"^' 
where is the index of the row of t containing i. Denote by Ci, . . . , Cy the columns of 
t and by Cj{i) the element in the i-th row of the column Cj. Then we associate to each 



column Cj a Vandermonde determinant 



Vane- := det 

'"3 



I ^C,(l) ••• ^C,(r,) 



-^rj 1 -^rj 1 



n (^c,(o - 



l<i<l<ri 



where Vj denotes the number of rows of Cj. 

The Specht polynomial St associated to t is defined as 

V 

St ■■= n^^^c, = sgn(a)(T(X*) , 

j=l o-eCStabt 

where CStabj is the column stabilizer of t as introduced in Section 12.41 The polynomials 
{st : t standard Young tableau to A} are called the Specht polynomials associated to A. 

Note that for any A-tabloid {t} the monomial X* is well defined, and the mapping 
{t} H- X* is an iS„-invariant mapping. Thus iS„ operates on St in the same way as on the 
polytabloid Cf. This observation implies (see [39]): 

Lemma 4.1. For any partition X \- n, the Specht polynomials associated to A span an 
Sn-suhmodule ofM\X] which is isomorphic to the Specht module S^. 

While Lemma 14.11 already gives a realization of the Specht modules in terms of polyno- 
mials, for the symmetry-adapted moment matrix we need to generalize this construction 
to realize these modules in terms of polynomials with prescribed exponent vectors. In the 
following, let n G N and /3 := (/3i, . . . , /3„) be an n-tuple of non- negative integers, and set 
]R{X^} := span{cr(X^) : a G iS„}. By construction, M{X''} is closed under the action of 
Sn and therefore has the structure of an iS„-module. 

Denote by wt(/3) = Y^=i A the weight of /3. Let fei, . . . , 6^ be the distinct components 
of /3 (called the parts of /3), ordered (decreasingly) according to the multiplicity of the 
occurrence in (3. Further let /j = {i G {1, . . . , n} : A = fcj}, 1 < j < ^, and note that the 
sets Ii, . . . ,Ie define a partition of {1, ... , n}. Setting /i^ := \Ij\, the vector /i = (/xi, . . . , fii) 
consists of monotonically decreasing components and thus defines a partition of n. We 
call fi\- n the shape of (3. 

Lemma 4.2. For f3 G Nq, the Sn-module M{X^} is isomorphic to the permutation module 
M^, where /i is the shape of (5. 

Proof. We construct an isomorphism from M{X^} to by defining it on the basis 
elements. 
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First observe that M{X^} = span{X'^ : 7 permutation of /?}. For a fixed permutation 
7 of /3, consider the set partition Ii, . . . ,Ie associated to 7, and map X'^ to the yU.-tabloid 
with rows h, ■ . ■ , h. Since this mapping commutes with the action of iS„, and since by 
Definition 12.101 the iS„-module M^^ is spanned by the set of all //-tabloids, the statement 
follows. □ 

Now let A h n be another partition of n. In order to construct the realizations of the 
Specht module as submodules of RjX'^}, we look at pairs {t,T), where t is a fixed 
A-tableau and T is a generalized Young tableau with shape A and content /i. For each 
pair we construct a monomial X^^'^^ E M.{X^} from its parts 61, ... ,6^ in the following 
way. As before, let Ci, . . . ,Ci, be the columns of t, and denote by T{i,j) the element in 
the i-th row and j-th column of T. Then define 



(id) 



'T(i,j) 

Ciii) 



and associate to each column Cj a polynomial 



(4.1) 



Van, 



Cj,T 



det 



^C,(l) 



J 



nj=i VanCj,T, and 
E 



5g{T} ^{t,S) 



As in Specht's construction we form the product polynomial S(t^T) 
set (by summation over the row equivalence class {T} of T) S(t^T) 

Lemma 4.3. Let X\- n, (3 E Nq, and fj, be the shape of (3. Further let t he a X-tahleau 
and T he a generalized Young tahleau with shape A and content fi. The Sn-suhmodule 
'^{S{t,T)} ofW{Xl^} generated hy the generalized Specht polynomial S(^t,T) is isomorphic to 
the Specht module . 



Proof. By Lemma IT2] we can follow Young's decomposition of M^. Therefore we associate 
to every T with shape A and content /i an i5„-homomorphism QT,t '■ — )■ MjX''}, which 
maps the given A-tableau {t} to X15g{t} X^^'^^ and which naturally extends by the cyclic 
structure of M^. 

Now it suffices to show that the image of C under 0r,t coincides with ]R{5'(t,T)}- 
The image of the polytabloid Ct from (12. lip is 



creCStabt 



o-eCStabt 



eT,ti^gnia)a{t}) . 



Since by the Leibniz expansion of (14. ip we have S(^t,T) = Ylaecstaht 

n(a)(T(X(*'^)), it 

follows that 6T,t(et) = S(t,T), which proves the claim. □ 

Remark 4.4. Note the following connection of the generalized Specht polynomials to the 
classical Schur polynomials. For a non- negative vector A = (Ai,...,A/) the generalized 
Vandermonde determinant 



(4.2) 



ax 



det ((X; 



ll<i,j<l 
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(as a polynomial in Xi, . . . ,Xi) is called the alternant of A. Moreover, for a partition 
A of length / the Schur function sx is defined by sx = ax+s/as, where 6 := (/ — 1,/ — 
2, . . . , 1, 0) e It is well known that sx is a symmetric polynomial in Xi, . . . ,Xi (also 
called a Schur polynomial) . Hence, the alternant (14. 2 p can be written as 

(4.3) ax = sx-5 ■ as ■ 

Now the polynomials Vanc^^T defined above can be seen as the alternant associated to 
the numbers (&t{ij)5 • • • 7^T(fcj)) and thus by (14. 3 p as the product of a Schur polynomial 
with a classical Vandermonde determinant. 

Let Tx^ denote the set of semi standard generalized Young tableaux of shape A and 
content fi. To conclude we can summarize the above considerations. 

Theorem 4.5. Let /3 G Nq o/ weight d and shape /i = /i(/3). Then we have 

nx'} = 00 K{%,T)}, 

where tx denotes the unique X-tableau with increasing rows and columns. The multiplicity 
of the Specht modules in this Sn-module is equal to the Kostka number Kxfi- 

Proof. By Lemma [4.21 the iS„-module MjX'^} is isomorphic to M^. By Proposition r2.14[ 
the multiplicity of in is Kx^, corresponding to the decomposition M'' = ®;^c>^ 
0^p^o 5''*' in terms of semi standard Young tableaux. Now for T G 7^° the iS„- 
homomorphism 6-^,* constructed in the proof of Lemma [4.31 maps Ct^ to S(tx,T) and thus 
turns this decomposition into the decomposition of MjX'^}. □ 

Based on these results, we can construct the symmetry-adapted moment matrix of 
order k. By (13. 5 p the blocks are labeled by partitions of n. In order to construct the block 
for a fixed A consider the various f3 = (/3i, . . . , with wt(/3) = k and shape A. For a 
given d, let c{fi,d) be the number of /3 G Nq with wt(/3) = d which have shape fi. The 
decomposition from Theorem 14.51 translates into the moment setting as follows. 

Corollary 4.6. For k G N, the k-th symmetry- adapted moment matrix Mjf{y) is of the 
form 

M^{y) = 0Afj;(y). 

Each of the blocks M^^{y) consists of kx rows and columns, where kx equals Y^d=o '^(/^' d')Kxf_i. 

Proof. The distinct irreducible representations are indexed by partitions of n. Therefore 
by Remark 13.61 the number of rows (and columns) of the block of M^^iy) corresponding 
to the irreducible component 5''*' equals the number of submodules of ]R[X]<fc isomorphic 
to S^. As we have 

(4.4) M[X]<, = R{X^}, 

this number is X]d=o ''(/^' Theorem 14. 5[ □ 
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Although the above Corollary is stated only in terms of the symmetry adapted mo- 
ment matrix, it naturally also translates to the localizing matrices. The only difference 
concerning the size of the localizing matrices is reflected in a slightly different calcula- 
tion compared to kx defined above. In the case of the localizing matrix associated to a 
polynomial g the summation will only go up to /c — \degg/2']. 

We obtain the following remarkable consequence. 

Theorem 4.7. For all n > 2k the symmetry- adapted moment matrix of order k has the 
same structure, i.e., the same number and sizes of blocks and variables. In particular, up 
to the computation of the block decomposition the complexity of the question if a symmetric 
polynomial of degree 2k in n variables is a sum of squares is only depending on k. 

Proof. First observe that by Remark 13.61 the number of variables equals the dimension of 
the R-vector space of symmetric polynomials of degree at most 2k. Therefore it corre- 
sponds to the number of n-partitions of 2k, which is just the number of partitions of 2k 
for all n > 2k. So we see that the number of variables does not increase in n once n > 2k. 

Now set no = 2k and let / be the number of partitions of k, /3^^\ . . . ,[5^^^ E Nq° the 
distinct exponent vectors modulo permutation with wt(6*^'^) = k, 1 < k < I, and A*^*-* h uq 
be the shape of (3^^\ The rest of the proposition follows if we can show that for every 
n > uq there exist partitions A^^'', . . . , A^'") of n such that = K^ii) for all 1 < i < m 
and = for all other A h n. 

First note Z?*-*-* that are exponent vectors come from the by adding n — no zeros. 
As n > 77-0 > 2A; this implies that the possible A*-'^ are of the form A^*) := (A?^ + n — 
no, Ag^ • • • , aI*"*). Since Kxf_i = whenever /i /^A we conclude that the possible fl we have 
to consider are of the form jl := (/ii + n — no,/i25 • • • , f^t) for one /i > A*^*^. But in this 
setting we have Kx^j^ = K-^^ and the statement follows. □ 

Example 4.8. We illustrate the techniques for a small example with n = 3 and k = 2. 
The moment variables are indexed by partitions of the numbers 1, 2, 3, 4 with three parts, 
i.e., 1/1, 1/2, 1/3, 1/4, 1/11, 1/22, 1/21, 1/111, 1/211- The irreducible components are indexed by the 
partitions A h (3), thus A G {(3), (2, 1), (1, 1, 1)}. The /3 we have to take into account are 
(0,0,0), (1,0,0), (2, 0,0), (1,1,0) with shape /i^ = (3),Ai(2) ^ (2, l),/i(3) = (2,1), fx^^^ = 
(2,1). The semi standard generalized Young tableaux with shape fi and content A G 
{A(^), . . . , A(^)} from Lemma are: 



For = (3): 



For//=(2,i; 



111 112 



• For /i = (1,1,1) there is no generalized semi standard Young tableau corresponding 
to the above A^*\ 

For fi = (3), Corollary 14.61 yields a 4 x 4-block, with basis polynomials 



{1, Xi + X2 + Xs, Xl + Xl + Xl, X1X2 + X1X3 + X2X3} 
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Thus 



M, 



(3) 



/ 1 

3yi 

3^/2 

V 3 2/11 



3yi 
32/2 + 61/11 
3 2/3 + 6 2/21 
62/21 + 3 2/111 



3 2/2 
3 2/3 + 6 2/21 
3 2/4 + 6 2/22 
6 2/31 + 3 2/211 



3 2/11 \ 
62/21 + 3-2/111 
6 2/31 + 3 2/211 
3 2/22 + 6 2/211 / 



For n 



(2, 1) we obtain a 3 x 3-block, with basis polynomials 

{X3 - Xi + X3 - X2, (X3 - Xi)(X3 + Xi) + (X3 - X2)(X3 + X2) 
(X3-Xi)X2 + (X3-X2)Xi} 

= {2X3 — X2 — Xi, 2X| — X2 — X^, —2X1X2 + X2X3 + X3X1} . 



Thus 



M, 



(2,1) 



/ 62/2-62/11 

62/3-6 2/21 

V 62/21 - 62/111 



62/3-6 2/21 

62/4-6 2/22 

-6 2/211 + 6 2/31 



62/21-62/111 \ 

-6 2/211 + 6 2/31 
6 2/22 - 6 2/211 / 



Hence we only have to check semidefiniteness of a 4 x 4 matrix and a 3 x 3 matrix, instead 
of semidefiniteness of a single 10 x 10 moment matrix. 

Remark 4.9. We remark that the techniques presented above also provide the tools for 
some explicitly stated open issues in the study of unconstrained optimization of symmetric 
polynomials in Gatermann and Parrilo [161 P- 124] (who - mentioning the lack of explicit 
formulas for the isotypic components - refer to the study of examples and asjTiiptotics). 

4.2. Sums of squares-representations for symmetric polynomials. From the dual 
point of view, the results presented in Section 14.11 imply the following sums of squares 
decomposition theorem: 

Theorem 4.10. Let p G IR[Xi, . . . , X^] be symmetric and homogeneous of degree 2d. If p 
is a sum of squares then 



p E 



where tx denotes the unique \-tableau with increasing rows and columns, P runs over the 
non-negative partitions of d with n parts, and T,{M.{S(^tx,T)}y denotes the sums of squares 
of polynomials in the Sn-module M{S'(t;^,T)}- 

Proof. The statement follows from dualizing (14. 4p in connection with Theorem 14.51 □ 

Hubert's Theorem (see, e.g., [29]) characterizes the cases where the the notion of non- 
negativity coincides with the sums of squares representability. For these cases we obtain 
the following corollaries which are specialized (and simplified) versions of SOS decompo- 
sitions in the symmetric case. 
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Corollary 4.11. Let p G M[Xi,X2] be a symmetric homogeneous form of degree 2d. If p 
is non-negative then 

p e S(M{XfiXf + X^'X^'}f + E(R{X^'X^^ - X^^X^'})^ . 

Q.-l,a2 SNq 
a ^ -\-a.2—^ 

Corollary 4.12. Let p G . . . ,X„] be a symmetric and homogeneous quadratic form. 

If p is non-negative then p can be written in the form 



p = a(Xi + --- + X„)2+/3^(X,-X,)2 = (a+(n-l)/3) J]x2 + 2(a-/3) 

i<j i i<j 

with some coefficients a, P > 0. 

Corollary 4.13. Let p G ]R[Xi,X2,X3] be a symmetric and homogeneous polynomial of 
degree 4- If p is non-negative then p can be written in the form 



p = {a + 26)Mi + (2a + 2e + 7 - 6)M22 + (/? - uj)M3i + (/3 + 27 + 2a; - 2e)M2i 



I5 



where = Y^^Xf, M22 = T.^^,X^X], M31 = E.^,^'^. and M2n = T.,^,^kXlX,X^, 
such that a, 7, 5, e > and > and Se > u"^. 



5. Using the degree principle 

For symmetric polynomials another possible strategy is to use the degree principle 
originally introduced by Timofte [HI Corollary 2.1] and recently refined by Riener [331 
Theorem 4.5], apparently not well-known in the optimization community. Using this 
principle, we show how to reduce an SDP-relaxation to a family of lower- dimensional 
relaxations. In some situations, this strategy might be preferable to the group-machinery 
developed in the above sections. In the special case of symmetric polynomials of degree 4 
it reduces the non-negativity problem to an SOS problem (and thus to a semidefinite 
feasibility problem) , see Theorem 15.51 

Proposition 5.1. [331 Theorem 4.5] Let f,gi,...,gm& ]R[X] be symmetric and K = {x & 
W : gi{x) > 0,...,gm{x) > 0}. Setting r := max {2, [(deg /)/2j , deg^fi, . . . , deg^frr*} we 
have 

inf /(x) = inf /(x) , 

x&K xeKnAr 

where Aj. denotes the set of points in R" with at most r distinct components. 

For n,r E N a. vector u = {ui, . . . ,Ur) of positive, non-increasing integers with n = 
ui + ■ ■ ■ + Ur is called an r-partition of n. Let fl denote the set of all possible r-partitions 
of n. Then for each a; G fi, set 

r := /(2V^,^V^, • • • ,Tr, ...,Tr)e M[Ti 
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Similarly, let K'^ := {t G M*^ : g'^{t) > 0, > 0}. With this notation we can 

transform the original optimization problem in n variables into a set of new optimization 
problems that involve only r variables, 

(5.1) inf fix) = min inf . 

Now one can apply the usual relaxation scheme to every of the above r-dimensional 
problems separately. For each a; G let be the fc-th relaxation (12.51) of miufgx" f^it), 
with optimal value denoted by inf Q'^. Putting these ideas together we obtain: 

Theorem 5.2. Let f,gi,...,gm G be G-symmetric, and let the feasible set K satisfy 

Assumption \2.1[ Lei r := max{2, [(deg /)/2j , deg (^i, . . . , deg (7^}, and Q be the set of r- 
partitions of n. Then the sequence (inf^gn(inf Qk))k converges to inf^gx f{x) for A; — )• 00. 

Proof. By Theorem 15 . 1 1 there is an r-partition u E Qoin with min^g/^ f{x) = min^g/^c^ f^{^)- 
It suffices to show that K'^ also meets Assumption 12.11 Since K meets Assumption 12. 1^ 
there is m G W[X] with u = uq + XljLi '^jQj for some sum of squares polynomials Uq, . . . ,Um 
such that the level set of u is compact. This representation carries over to u'^ which also 
has a compact level set. □ 

Remark 5.3. At first sight it might not look profitable to replace one initial problem by 
a family of new problems. However note that for fixed r G N the number of r-partitions 
of any n is bounded by [n + r)''. On the other hand a polynomial optimization problem in 
n variables yields a moment matrix of size 0{n^) in the k-th relaxation step of Lasserre's 
scheme. In view of the polynomial bound (for fixed r) on the number of r-partitions it is 
therefore profitable to use the degree principle-based relaxation. 

The process of building the r-dimensional problems can be related to breaking the 
symmetries as the resulting problems will in general no longer be invariant under a sym- 
metric group Sr- However as dimensions drop there are situations where we will get finite 
convergence. 

Theorem 5.4. Let f,gi,...,gm G ]R[X] be symmetric with deggj < m, 1 < j < m, and 
deg/ < 2m. Further assume that the variety V{gi, . . . , gm) ^ has codimension m. 
Then the relaxation sequence {mf^(zQ{Q'^))k converges to inf^gv^(gj^...^g^) / in finitely many 
steps, where Q is defined as in Theorem \5.S[ 

Proof. It suffices to show that each of the varieties := V{gi, . . . , g'^) is zero-dimensio- 
nal and then Proposition 12.41 gives the announced statement. To see that these varieties 
contain only finitely many points we proceed as follows: 

It is classically known (see for example [9l §7.1]) that every symmetric polynomial g of 
degree d in n variables can be uniquely written as a polynomial in the first d power sum 
polynomials Pi{X), . . .,Pd{X), where Pi{X) = YTj=i ^j- 

Let 7i . . . , 7m £ ^[Zi, . . . , Zm] C M[Zi, . . . , Zn] be polynomials such that ji{pi{X), . . . , 
Pm,{X)) = gi{X). The surjective map 

TT : C" ^ C", 

X ^ {pi{x),...,Pn{x)) 
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establishes that C"'//Sn (the so-called orbit space, cf. Section |6]) is in fact isomorphic to 
C". 

As the variety V{gi, . . . , gm) is iS„-invariant, its image in the quotient C"/ /Sn is given 
hj V := {z E C"' : Ji{z) = 0, 1 < i < m}. Since iS„ is a finite group the codimension of V 
is also m. But this implies that V (1 {z E C^' : z^+i = ■ ■ ■ = = 0} is zero- dimensional. 
Therefore there are just finitely many z := {zi, . . . , Zm) with '~fi{z) =0 for 1 < i < m. 

Now let u = (cui, . . . , Ur) be any r-partition of n and consider := V{gf, . . . , f?^) C 
C™. Setting pi := ^JLiCUjTj, we get (7^ = 7i(pi, . . . ,Pm)- For the points y G l^'^ we have 
Pi{y) = zi,.. .,Pm{y) = Zm for one of the finitely many z = {zi, Zm), with 7,(2;) = 
for 1 < z < m. And thus there are just finitely many points in V^. □ 

Closely related to the question of finite convergence is the description of polynomials 
that are positive but not sums of squares. By Hilbert's Theorem, every non-negative 
ternary quartic polynomial is a sum of squares. For quartics in more than three variables 
this is not true in general, not even for symmetric polynomials (see Example 15.61 below). 
However, for symmetric polynomials polynomials of degree 4, deciding the non-negativity 
can be reduced to an SOS problem and thus to a semidefinite optimization problem. 

Theorem 5.5. Let f G W[X] be a symmetric polynomial of degree 4, (^nd let Vt he the set 
of 2-partitions of n. Then f is non-negative if and only if for all u E Q the polynomial 
is a sum of squares. 

Proof. As / is of degree 4, for any w G the polynomial is of degree 4 in two variables. 
Hence, by Hilbert's Theorem /'^ is non-negative if and only if it is a sum of squares. □ 

Example 5.6. Choi and Lam [8] have shown that the homogeneous polynomial of degree 4 

/ = ^X^Xl + ^X^X.Xfe- 4X1X2X3X4 

in four variables is non-negative, but not a sum of squares. By Theorem 15.51 the non- 
negativity of / is equivalent to the property that the following two homogeneous polyno- 
mials in two variables are sums of squares. We find 

/i = X2' + 4 X^X^ + XI + 2 X|X2 = [XlY + [Xl + X2X4) ' + (^3X2X4) ' , 

/2 = 4 X2^ + 6 X^X^ - 2 X|X4 = (^Xl - \X2X^ + Q V23X2X4 
which proves that / is indeed nonnegative. 

6. PMI-RELAXATIONS VIA THE GEOMETRIC QUOTIENT 

In this section, we study another possibility to exploit symmetries. Namely, we want 
to exploit the fact that to any solutions of an invariant optimization problem every point 
in its orbit is also optimal. Using invariant theory and a result in real algebraic geometry 
it is possible to characterize the space of all orbits. This orbit space approach leads very 
naturally to polynomial matrix inequalities (PMI). The main advantage of this approach 
is, that in some cases, this can decrease the degrees of the polynomials strongly. We will 
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demonstrate this phenomenon in certain cases (such as power sum problems) where we 
obtain lower bounds and sometimes even upper bounds for a minimization problem by a 
very simple SDP relaxation. 

6.1. The general setup. We consider the general G-invariant optimization problem (11. ip . 
where G C GL„(M) is a finite group. Denote the orbit of a; e by G{x) := {cr(a;) : a e 
G}. The union of all orbits (with the induced topology) is called the orhit space M"/ /G 
of G. In order to characterize the orbit space, let tti, . . . , tt; be generators of the invariant 
ring of G [fundamental invariants) . The projection 

TT : M" ^ W//G C 

X (7ri(x), . . . ,7ri(x)) 

defines an embedding of the orbit space into M'. In contrast to the complex case (see [H]) 
this map is not surjective in general. We highlight this phenomenon with the following 
example: 

Example 6.1. Let G = be the dihedral group acting on R^. Fundamental invariants 
that generate C[X, Y]^*' are given by fi=x'^ + and /2 = x^y^ (for general methods to 
compute fundamental invariants we refer to [TT]). As /i and /2 are in fact algebraically 
independent, we find that C'^//-D4 ~ C^. In the complex setting every solution to the 
linear system = = oli for some (ai, 02) G will give rise to an orbit of solutions 

of fi{x,y) = ai,f2{x,y) = ^2. But since for optimization purposes we are interested in 
real solutions we have to restrict the map tt to M^. Obviously, the image 7r(M^) is contained 
in R^. On the other hand, as fi{x,y) > for all {x,y) G R^, we have 7r"^((— 1,0)) ^ R^. 
Hence, the restricted map 7r|K2 is not surjective. 

Therefore, in order to describe the image of R*^ under tt we need to add further con- 
straints. In Example 16. II for instance, the property fi{x,y) > for all {x,y) e R" implies 
7r(R^) C {[zi,Z2) G R^ : Zi > 0}. Thus it seems promising to add such positivity con- 
straints to characterize the image 7r(R"') as a semi algebraic subset of R*^. This is indeed 
possible and the characterization has been done by Procesi and Schwarz, who have deter- 
mined polynomial inequalities which have to be taken additionally into account in order 
to characterize the embedding of R"//G into the coordinate variety of R[X]'^ of G (see 
also Brocker [6]). We outline this briefiy: 

First note that there exists a G-invariant inner product (■, ■) on R[X]. For a polynomial 
p the differential dp is defined by dp = Yl^=i ^'^•^i- Then carrying over the inner product 
to the differentials yields {dp,dq) = YTj=i{^i ^) • The inner products {d'Ki,d7ij) {i,j G 
{1, . . . ,1}) are G-invariant. Hence entry of the symmetric matrix 
(6.1) J = {{d7ii,d7ij))i<ij<i 

is G-invariant and can therefore be expressed in terms of tti, . . . , tt;. 

Proposition 6.2 (Procesi, Schwarz [31]). Let G C GL„(R) be a finite group and n = 
(vTi, . . . , TT/) be fundamental invariants of G. Then the orbit space is given by polynomial 
inequalities, 

My/G = 7r(R") = {z G R' : J{z) hO, zE V{I)} , 



J 
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where I C M.[zi, • • • , 2/] is the ideal of algebraic relations among vri, . . . ,111. 

Example 6.3. Continuing Example 16. ![ we have ^ = 2x, ^ = 2y, ^ = 2xy'^, 
^ = 2x'^y. Expressed in the original variables x, y, and in the fundamental invariants 
/i, /2, respectively, the matrix J from (16. ip is 

'4(x2 + |/2) 8xV \ _ f^fi 8/2 

8xV 4(xV + yV)y' - 1^8/2 4/1/2^ 

With the principle minors of J (which are 4/i, 4/1/2 and 4/i ■ 4/1/2 — (8/2)^), the orbit 
space is given by 

R'^//D4 = {(21,22) e : 4^1 > 0, 421^2 > 0, 16zlz2 - (8^2)^ > O} . 

Let / and ^1, . . . , be the expressions for / and gi, . . . , it^ the fundamental invari- 
ants. By Proposition [6]2l the G-symmetric optimization problem (II. ip can be equivalently 
expressed in the orbit space: 

inf/(2) 

(an) S.t. Z G y(/), 

^ ■ ^ ~9ji^) > 0, l<J<m, 

j{z) y 0. 

This is a PMI (as introduced in Section 12. 2p and one can use the techniques introduced 
there to derive an SDP relaxation scheme. Let si{z), . . . , Sr{z) be generators for the alge- 
braic relations among tti, . . . , tt;. Then (12. 7p yields the hierarchy Q^J of SDP relaxations 

inf,L(/) 

Mk{y) h 0, 

(6.3) g//; Mk-d{Jy) h 0, 

Mk-idcggj/2-] {gjy) h , 1 < j < m , 

Mk-ldegs,/2-] (sjy) = , 1 < j < r , 

where k > ko := max{ [deg //2] , [deg^/2], [deg Sj/2] , c?} and d = max{ [deg Jjj(Z)/2] }. 

Theorem 6.4. Let f\gi, . . . , gm he G-invariant. If the PMI in (16. 3p meets Assumption \2.5\ 
then the sequence (inf (5fc^)fc>fco is monotonically non- decreasing and converges to /*. 

Proof. By Proposition 16. 2l the problem described by / and gi, . . . , gm is equivalent to (16. 2p . 
Now we can conclude with Proposition 12.61 □ 

Remark 6.5. It would be very interesting to characterize the situations where (16. 2 p meets 
condition 12.51 in terms of the original set K. 

6.2. Lower and upper bounds for power sum problems. For constrained poly- 
nomial optimization problems described by power sums, the PMI become particularly 
simple. We will use the first relaxation of the sequence (16. 3 p in order to derive bounds for 
a particular class of problems. 
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Let n, m, g G N with q > m, m < n + 1, and given some vector 7 G M'" ^, consider the 
symmetric global optimization problem 



n 



(6.4) Pnmq ■ Hlin ^ xj S.t. ^ = 7fc , j = 1, . . . , m - 1 , 

i=l 1=1 

with optimal value denoted minP„mg. Here, we provide upper and lower bounds for Pnmq- 
Choose the fundamental invariants nj = jSj {1 < j < n) where Sj := Yl^=i^i denotes 
the power sum of order j. Then the matrix J{z) specializes to the Hankel matrix Hn{s) = 

(Sj+j-2)l<i,j<n- 

We can exploit the double occurrence of power sums: within the optimization problem 
and within the Hankel matrix. Namely, for m < n + 1 and m < q < 2n — 2, consider the 
following semidefinite optimization problem 

(6.5) Lnmq = min { Sg \ Hn{s) h ; Sq = n; Sj = 'jj, j = 1, . . . , m - 1} . 

s 

Theorem 6.6. Let n, m, g G N with m < n + 1, m < q < 2n — 2, and let Pnmq be as in 
( [6'.^| ). Then one obtains the following lower bounds on minP^mg- 

(a) UlinPnmq ^ ^nmq- 



(b) If q = m = 2r for some r, write 



Hr+i(s) 



Hril) 




^(7) 


S2r 



^rilY = (7r, • • • ,72r-l) 



with 7o = n. Then minP„mg > ^r(7) Hr{,l)ur{l) ■ 

Proof, (a) Consider the equivalent formulation to (16. 4p in the form (16. 2p . Since J{z) is a 
Hankel matrix, every solution to this PMI is feasible for (16. 5p . 
(b) In case q = m = 2r < 2n, we observe r < n and 

HJs) = 



Hr+l{s) 


U{s) 




V{s) 



for some suitable (possibly empty) matrices U{s) G M('^+i)x("-^-i), V{s) G ]^{n-r-i)x{n-r-i) _ 
Therefore, Hn{s) >z implies Hj.+i{s) y 0, and the final result follows from Schur's com- 
plement applied to the Hankel matrix Hr+i{s). □ 

In certain cases, we can complement this lower bound for problem (11. ip by an upper 
bound. The idea is to consider potential solutions x G M" of Pnmq with at most m non-zero 
components. 

Consider the monic polynomial p = X"" + YJ^Zq VjX^ G M[X], and let Xi , . . . , x-m ue 
the m roots (counting multiplicities) of p. A necessary and sufficient condition for all 
roots of p to be real is that Hni{s) >z 0, where Hm{s) is the Hankel matrix with sq = m. 

When q < 2m — 2, we investigate the following SDP problem 

(6.6) Mnmq = Hliu { Sg \ Hm{s) h ] Sq = 711 ; Sj = 'Jj , j = 1 , . . . , m - 1} , 
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which the same as (16. 5p except that we now have a Hankel matrix Hm{s) of dimension m 
instead of Hn{s) of dimension n. 

It is well known that the Newton sums Sk = Yl^=i-^jy k > 0, of p are known 
polynomials in its coefficients {pj}, and conversely, the coefficients pj of p are polynomials 
in the s/s. i.e., we can write Sj = Pj{po, . . . ,pm-i), j > for some polynomials 
Pj G M[po; • • • ,Pm-i]- In fact, the sis and the pj^s are related by Newton's identities, 

Sfc+Pm-lSfc-lH \-poSk-m = {k > TJl) , 

Sk+Pm-lSk-1^ \-Pm-k+lSl = -kpm-k {1 < k < Tu) . 

If one knows Sj for all j = 1, ... ,m — 1, then one may compute the pj's for all j = 
1, . . . , m — 1, and therefore, we can choose as unknown of our problem the variable po (the 
only (constant) coefficient of p that we do not know), and write 

Sj = Pj{po,...,pm-i) = Qj{po), j = m,m + l,. . . 

for some known polynomials Qj G M[po]- We claim that Qj is affine whenever j < 2m — 1. 
Indeed, this follows from 

Sm = -SoPo - SlPl Sm-lPm-1 , 

Sm+1 = "SiPq — ■ ■ ■ — Sm-lPm-2 ~ SmPm~l 

= -SlPo Sm-lPm^2 + Pm.~l{soPO + SlPl H h Sm-lPm~l) 

= -Po{Sl - SoPm-l) - Pl{s2 - Pm~lSl) Pm-l{Sm - Pm-lSm-l) , 

Sm+2 = ~S2P0 — ■ ■ ■ — Sm-lPm-3 ~ SmPm-2 "~ -Sm+lPm-l 

= -P0{S2 - Pm~2S0 + Pm~lSl - SqP^-i) ) 

Sm+3 = ~Po{s3 — + ■■■) — ■■• 

Therefore, with q < 2m — 2, the SDP problem (16.61) reads 
(6.7) Unmq = Hiiu { Qg{po) : ^^^(s) ^ 0} , 

Po 

where Sq = m and all the entries Sj of Hm{s) are replaced by their affine expression Qj{po) 
whenever m < j < 2m — 2. This is an SDP with the single variable Pq only. 

Theorem 6.7. Let n,m,q E N with m < n and q < 2m — 2. Let P„mg be as in \6.4\) and 

let \]nmq he as in ^fi^ . Then mmVnmq < l^nmq- 

In addition, if Pnmq has an optimal solution x* G with at most m non-zero entries, 
then minPnmq = ^nmq and so P„mg has the equivalent convex formulation ( [g. 7p . 

Proof. Let po be an optimal solution of the SDP (16. 7p . and consider the monic polynomial 
p G M.[X] of degree m which satisfies the Newton identities with Sj = 7j, j = 1, . . . , m — 
1. The vector x = (xi, . . . ,Xm) of all its roots (counting multiplicities) is real because 
Hm{s) ^ 0, i.e., its Hankel matrix Hm{s) formed with its Newton sums Sj, j = 1, . . . , 2m — 
2 (and Sq = m), is positive semidefinite. Let x* = (x, 0, . . . , 0) G M". By definition of the 
Newton sums of p, one has Yl^=ii^*iY = YlT=i •'^i ~ Ik, k = 1, . . . ,m — 1, which shows 
that X* is feasible for Pnmq- Therefore, Unmq = Sg> minP^img, the desired result. □ 
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